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I. 



INTRODUCTION 



Photogrflphs have been used In learning situations since the 
early days following their Inception. Their presence has been 
accepted much of the time as highly contributory to better under* 
standing. The matter of research to support this Idea has not 
been Ignored for there have been a number of studies concerned with 
the value of pictures In educational usage. Some of them have 
supported picture use with various qualifying conditions Involved 
and many others have either been negative or npt significant In 
their findings. 

This need to know more about the effectiveness of pictures 
In learning by one’s self lies In the nature of most of the current 
programed Instruction. The Idea of programed instruction Is 
largely the result of studies experimenting with the arrangement 
and sequence of printed symbols which represent words and Ideas. 
Further, If the only Instruction given is In terms of printed 
symbols, then the learner must know the meanings represented by 
those symbols. Therefore, wouldn’t accurate photographs, specifi- 
cally made for a self-instructional program help a student learn 
better since meanings would probably be clearer for him? 

In addition, the writers of such programs are, in many 
cases, carrying the responsibility for all of the Instruction 
given In entire segments of a curriculum. Highly fundamental 
experiences upon which many succeeding learning skills are found»ed 
have to be developed. 

Therefore, If there la a taxonomy of learning objectives, 
there would, as well, be a taxonomy of methods by which learning 
can be effected. There Is a naturalness about turning to iconic 
representation (photographs and other forms of pictures) to develop 
accurate fundamental experiences that will Implement curriculum 
content. 

Furthermore, most persona today are highly conscious of 
pictorial media In educational materials. The comnon Involvement 
of people with the motion picture, television, highly Illustrated 
periodicals, and a great many other sources of non-print visual 
stimuli tends to make them more responsive to visual pictorial 
learning than to print alone. 



To Increase the usefulness of this study , certain minor 
hypotheses were tested In addition to the major analysis. These 
were examined as time and funds permitted. It has been a study 
for the purpose of Illumination and better understanding rather 
than one that sought for a final verdict. The need for this 
study became apparent concurrently with the writer's involve- 
ment in another research problem. ( 16 ) 



The Problem 



If iconic representation (picture) develops more than one 
thought stimulus at a time and can provide for a complex of 
perceptual experiences, It would be reasonable to expect that a 
pictorial Intrinsic program could re)y on picture more and on 
caption and printed information less and still produce as good a 
grade of Instruction as a similar Intrinsic program which depended 
entirely upon symbolic representation In the medium of print. The 
major problem was to determine the effect of the Iconic materials 
(color photographs) on the Improvement of performance and the gain ** 
In learning In a given Instructional situation utilizing Intrinsi- 
cally programed study materials. 

The null hypothesis tested Is there Is no significant 
difference In the terminal functional behavior of the subjects 
when the Information Is presented by means of automated instruction- 
al materials Incorporating color photographs, and by means of 
similar Instructional materials containing no photographs (or 
other pictures). 

One of the best determinants of adequate Instruction is the 
quality of behavior one is able to observe when what has been 
taught in the learning experience Is {applied In a practical 
situation. In accepting this premise this study thus holds Its 
attention to observing fxmctional terminal behavior rather than 
only the results of a (given) written test. 



Purposes and Importance 

This sciidy was carried out to relieve the apparent dearth 
of carefully controlled research aimed specifically and exclusively 
at the effectiveness of pictures In Intrinsic (branching) programed 
materials. 

Furthermore, although this study was concerned primarily 
with the application of Iconic representation (color photographs) 
to Intrinsic programed Instruction there are Is^llcatlons for 
research, utilization, and the design of educational media. The 
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Importance of a study such as this Is emphasized by the large 
amount of activity devoted to developing media to be used as basic 
Instruction which depend upon pictorial and other visual content. 
Thus» Investigation of an assumption that programed pictorial 
loaterlals may be more effective than programed non-plctorlal 
materials provides some direction for those preparing any kind of 
instructional materials as well as for those Interested only In 
programed instruction. 

Furthermore, during the last decade there has been rising 
emphasis on perceptual sensory stimuli in plans for the learning 
experiences of the curricula for higher as well as primary and 
secondary education. It has created a demand for more knowledge 
about the effectiveness of pictorial content. This demand has 
been Intensified by refinements In the technology associated with 
the use of computers for teaching. These advancements allow for 
the use of pictorial materials In the learning programs designed 
for computer assisted instruction. The adaptability of the Intrln* 
sic (branching) program to this form of educational technology was 
one of the motivational factors behind the submission of the 
proposal for this study. 

Instruction having objectives related to task performance; 
the application of procedures and rules; and skill in making an 
analysis of the factors of a problem, should benefit significantly 
by having a more positive understanding of the role of photo- 
graphic material In programed Instructional materials. 



Review of Related Research 

In spite of the fact that Iconographlc representation has 
been historically an intrinsic part of communication between 
human beings, there Is surprisingly little research which is clear 
cr very definitive concerning the effectiveness of transferring 
Ideas thru the medium of the picture. 

Popular and textbook writing for educational use has 
rather consistently extolled the values of the picture ever since 
John Amos Comenlus Inserted drawings Into his seventeenth century 
Latin book, but much of the research about pictures done In recent 
years has wound up asking more questions and suggesting more Ideas 
for further research than providing positive Information upon 
which to advance the art of teaching. 

The literature examined in preparation for this study was 
delimited by the premise that our evaluation of pictures must be 
related to direct instruction. In other words » In order to be 
counted relevant there must have been reliance on the picture at 
least for part of the instruction given In connection with the 
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research reported on, A study of pictures related to the psychology 
of perception or discussions of the esthetics of pictures In learn- 
ing Is not considered to be within the scope of this study. 

At the time of the Inception of this study (1960), no 
analytical studies were on record as dealing with the effectiveness 
of color photographs In the Instructional content of programed mate- 
rial. A number of popular research-related discussions about 
programed materials mention pictures or drawings as being In the 
programs. In some of them, pictorial material was Inserted mainly 
as relief from the monotony of print. 

A bit of exploratory < v«erlmentatlon close to the thinking 
behind this study Is the resu^iL of the curiosity of Kenneth Dale 
Issacs (1962- ) of the Illinois Institute of Technology. His 
experiments have been more centered on devices and on environment 
for making pictorial Impact In teaching than on an analysis of 
functional behavior as a result of pictorial stimulation In learn- 
ing situations. However, when, as Interviewed by Gowran» he says 
he Is concerned with Instruction that relies on the "Incredible 
ability of the eye to take In meaningful Images which can be used 
later," (8) he Is very close to the rationale behind this study 
which Is concerned with the Influence which stored pictorial images 
have on terminal functional behavior. 

Other studies such as those of Buswell (1), Barnes (6), 

Brown (12), Gagne" and Foster (7), Spaulding (10), and Lefkowlth 
(15), have made valuable contributions to knowledge In connection 
with pictures. However, they were not particularly useful In 
connection with the problem to which this Investigator has given 
his attention. Their concern was with various factors related to 
the application of pictures within the framework of education but 
not with the general aspect of direct teaching effectiveness or 
with programed Instruction In particular. In addition, the finding 
of a large number of pictorial studies where the effect of the 
Independent variables was not significant bore heavily on the 
design of this experiment. The possibility of some common overly- 
Influentlal factor in this situation became apparent. It was 
decided such a factor probably was related to the mode of evalua- 
tion used. The literature revealed the common use of evaluation 
Instruments requiring written responses to measure the effect of 
pictorial (non-verbal symbolic) stimuli. The evaluative pro- 
cedures reported seemed even less congruent to pictorial In- 
structional procedures when the behavioral objectives were percep- 
tual-motor In the Immediate functional situation and were cognitive 
with respect to the application of principles learned to various 
activities beyond the range of the Immediate experimental learning 
experience. 
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The Influence of these observations led to the designing and 
Inclusion In this experiment of a performance rating scale as one 
of the major parts of the evaluation procedure. 

There Is one recent study, that of Magne and Parknas (1963) 
yhlch, although not Involved with programed learning j nevertheless 
supports the findings of this study In connection with the premise 
that the recurrent non-slgnlflcance of differences between picture 
and no picture groups In so many studies Is, at least In a substan- 
tial part, due to the almost exclusive use of verbal (most of the 
time written) test procedures to evaluate results of all experi- 
mental procedures. 

The Magne and Parknas study obtained significant differences 
In favor of the picture group when their evaluation Instruments 
were compatible with the kind of behavior being taught. 

The literature dealing with computerized Instruction or 
research utilizing computers in connections with pictorial elements 
In learning Is too Immature to give more than encouragement that 
this kind of equipment Is capable of presenting and controlling 
Instruction that Is at least partially dependent upon pictorial 
elements. Continued study In this area Is contemplated by this 
Investigator. 

In summarizing the literature review. It seems sufficient 
to point out that research In connection with Instruction through 
iconographic stimuli (pictures) In general Is not truly definitive 
and Is even less helpful in the particular area of programed 
Instruction • 



Plan of the Study 

The study was divided Into four stages. The first was 
devoted to the preparation of the experimental program and the 
performance rating Instrument. The experiment was run as the second 
stage. Analysis of the data was undertaken at this point. Some 
of the Indications of this analysis suggested that further research 
would be profitable with respect to certain facets of the experi- 
ment. The third stage then consisted of the running of the 



^Author’s note: This study had not been published at the 

time the experiment was conducted and had not been reported In 
American educational research Journals. 



subsidiary experiments on certain of these facets* 
report was prepared as the last stage* 



The final 



Definition of Terms 

In this study the terms”lconographlc stimulus” and "picture” 
refer to projected Images of color photographs twelve by eighteen 
millimeters as part of the two-by-two slides projected on a screen* 
The term "print” Is used to describe the captions or descriptions 
prepared in symbols of the alphabet* Two alternate versions of a 
program were developed* Both were presented on slides* The one 
utilizing pictorial material as an Integral part of the basic 
Instruction was called the "Picture-Print” program* The other 
contained no pictures and rolled on print as the sole method of 
Instruction* This version was named the "Print” program* 

The study employed two groups for each experiment* One 
group was labeled "picture” group* This group received instruction 
from the program which relied on Iconographlc material (pictures) * 
The group which saw no pictorial material was defined as the "print” 
group. Therefore, the term "print” does not refer to material 
printed on paper Aether the reference Is concerned with a group 
of subjects or the Inst relational program* The term "performance 
rating scale” is the nai^ie given the evaluation Instmment which 
was used to test the effectiveness of the Instruction in producing 
.he desired functional terminal behavior* 

"Learning Room" describes a room specially built to Isolate 
subjects from Interference and distraction while they were study- 
ing the programs* 

specific terms used In connection with the "hardware" 
used in this experiment will be defined as they are Introduced* 
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II. METHOD 



Preparation of Materials and Measurement Instruments 



Materials 



ERIC 

iaffami353 



This study has > as Its predecessor , another experiment , (16) 
which used a course of study consisting of four units of programed 
material relied heavily on color photographs plus printed captions 
to do the teaching. These were presented to students on 2 x 2 slides. 
Tills pictorial program was employed as the mode of Instruction for 
the control group of the present study. 

To obtain the experimental program It was necessary to 
convert the highly visualized program of photographic material to 
a similar branching program having no pictures at all* Each of the 
pictures In the previously used program was analyzed and Its 
content carefully expressed In print form, being very careful that 
the Instruction presented in print form should have as near as at 
all possible the same Instructional content as the frames which 
had consisted of picture and caption. The result was an entirely 
new program using exactly the same branching pattern as the pictorial 
program and as near as possible being a duplicate of the Instruc*" 
tlonal content. This program was labeled the "print only" program. 
Since the subject matter being taught was Identical frame for 
frame, it was considered quite safe to assume that any differences 
which might appear in the evaluation of learning which took place 
among the subjects employed In this study would be due to the 
variable of "no picture" which was Introduced by this method. 

Appropriate forms were designed to manage the records for 
each of the two groups from which the data were obtained. 

All the Instruction with these programs was given on a spe*- 
clally designed teaching machine using random selection projection 
of the slides. This equipment was housed In a special sound- 
proof projection booth attached to the learning room used In the 
experiment to which previous reference has been made. The student 
subject studied the program by controlling the projection equip- 
ment from a remote control paneji having a digital system keyboard. 
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This control panel was especially designed to minimize learner 
attention to the electro-mechanical equipment In the experiment. 
This hope was realized In that mistakes and fumbling due to the 
fact that an electro-mechanical device was being used In place of 
the more traditional pencil and paper were the negligible to such 
a degree as can be very comfortably Ignored.^ 



Measurement 



Performance Test 

The study of a non-verbal communicating agent like the 
picture requires a non-verbal mode of assessing the effect of the 
use of the picture In a teaching situation. In almost any learn- 
ing situation dealing with ability to perform, the sought-for 
objective Is efficient functional behavior of some sort at a level 
of proficiency that Is determined by the stated objectives. No 
known previous attempts to evaluate perceptual-motor and cognitive 
terminal behavior emerging from Instruction with pictorial pro- 
gramed materials for library training had been made. 

For this study the writer Invested a substantial amount of 
time and energy to devise a performance measuring Instrument^ which 
could be relied upon to discriminate between adequate and Inade- 
quate performance In the use of the library for enrichment and 
research purposes. To evaluate non-verbal teaching materials with 
no more than verbal, written responses was ruled out as Incompat- 
able with the behavioral objectives of the programed materials 
used. It was recognized that such an Instrument should measure both 
a student’s knowledge about the library facility and his ability 
to apply the principles taught so he could actually put his hand 
quickly on the material he wanted. The Instrument used was con- 
structed after examining (Silvern and Linn, 1957) certain well 
tested performance evaluation devices used for similar kinds of 
behavior In Industrial training applications known to this researcher 
through his previous consultation activities In that area. It 
required the subjects to function In the actual environment of the 
library In response to problems which were given to them by a 
competent examiner. 



A detailed description of the development of the mechanical 
equipment used In this study Is presented In Appendix A of the 
final report to which previous reference has been made. See 
footnote p. 2 

^See i^pendlx "B" 
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This perfotm^cs measutlng Ihsttument wad In the form of a 
rating scala which utlliaad a' five-point scale. It correlated 
+.05 with the crlterdon pretest and +.65 with the post*-test. The 
time used by a subject to itomt>lete the sections of the assignment 
re(}ulred by the rating stale waS recorded to the nearest second 
by the examltiets. This performance test thus provided both Infor- 
mation on accuracy of performance and the time taken by the subject 
to complete the test. 



Criterion Test 



In order to measure the amount of verbal knowledge the sub- 
jects had about the library and Its use, a written criterion test 
was devised. After examining- apparently the only presently 
published library usage test which had a degree of standardization 
and upon finding that It was not satisfactory for the library In 
which the experiment was conducted as well as being too strongly 
oriented toward the larger amount of detail required of the 
beginning professional librarian. It was decided that It would be 
necessary to prepare a carefully designed test which would function 
as the pretest and the post-test for the experiment . Although this * 
test was used very successfully by an earlier experiment (16) 
Involving this researcher. It was further refined for this study. 

The reliability as tested by Kuder-Rlchardson formula 20 ranged 
from .76 to .83. 

Measures were obtained from the University Student Records 
on a number of dependent and Independent variables for each subject. 
Some of the dependent variables were: the time It took the student 

to complete the program; the number of by-passes the student 
successfully passed during the program; the gain score on the 
library usage test; and the number of errors made by the subjects 
while studying the program. The error rate was recorded for the 
major experiment by the use of a twenty-one pen Esterllne-Angus 
Recording Device. 



Standardized Tests 

A number of Independent variables were obtained. These 
were the students' scores on the verbal part of the School and 
College Ability Test, their English Proficiency scores (which 
Included measures of reading comprehension and reading vocabulary), 
and the pretest on knowledge about the library. 



^Bureau of Publication, Teacher's College, Columbia 
University, New York. 
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Procedure 



The subjects used were volunteer freshmen taken from the 
beginning English classes at Southern Illinois University. They 
were randomly divided Into two groups on the basis of when they 
registered for the library program. The first person was assigned 
to group 1 ftnd the second person following would be assigned to 
group 2, and so on. Group 1 was labeled "picture group" and group 
2 was given the designation* "print group". 

Each student registered for all of the four units of the 
library program. He was allowed to sign up for all or part of his 
training In advance. Some students took all four programs In one 
session. This usually recjulred two hours or more. Other students 
took two programs In one session and two In another session or * 
one program In one session and two In the next* and one In the third* 
or they might have taken the four programs successively In four 
separate sessions. There was no attempt to regulate the manner In 
which the subject completed his study. The schedule allowed was 
largely determined by a subject’s class program. Each subject was 
required to finish the program of study within the limit of the 
normal University quarter. 

Immediately following the Instruction* the subjects were 
allowed to take the post-test. Most subjects completed the tests 
within three or four days after finishing the program of study on 
the machine. 

After taking the criterion post-test* the performance 
evaluation using the rating scale was made. Three performance 
tasks were presented to the subject on a 4 x 6 card. The subject 
was required to find the catalog cards for books on a particular 
subject In the card catalog. He was then to look for a book by 
the title and the author In the author-title card catalog* find 
It on the shelf* and write out a call card for the book. The 
third task on the test required the subject to use the Reader’s 
Guide to Periodical Literature In order to find In which periodical 
a certain article had appeared. This task required the student to 
work from knowledge of the title and the author of an article with- 
out Information as to the name of the periodical In which It appear- 
ed. Subjects were then required actually to locate the article In 
the proper periodical on Its shelf position In the library. 

The evaluation of performance In the functional situation 
was made by examiners who observed the subjects as they proceeded 
through the library completing the tasks required by the performance 
test. An Initial pilot trial of the use of the test showed that 
the examiner was unlikely to cause an amount of apprehension 
sufficient to Interfere with the obtaining of reliable data. 
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Each subject had two records as a result of his instruc- 
tional experience. One was his data card and the other was the 
prlnt-out record of his behavior on the teaching machine. A 
follow^up questionnaire was distributed to the subjects at the 
end of the quarter In which thc^y had the Instruction. 
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III. 



RESULTS OF THE EXPERIMENT 



Appraisal of Groups 

For three groups of subjects; the picture group, the print 
group, and the "casualties"! :Table 1 Ustj the following Information: 
the means of the English proficiency test and Its sub-tests, 
reading vocabulary and reading comprehension* the verbal section 
of SCAT, the criterion pre-test, the criterion post-test, the gain 
score, and the number of subjects (N) . Table 1 also lists the jt 
value for each of the scores between the picture group and the print 
group and the confidence level, "p". 

It can readily be seen that the picture and the print groups 
were significantly different on almost all variables except reading 
comprehension for which the "jt" was close to significance at the 
.10 level of confidence. These significant differences determined 
the use of analysis of covariance. When the criterion pre-test 
scores were held constant, there was no significant difference 
between the two groups. The same held true when the reading com- 
prehension scores were held constant. However, when the SCAT 
scores were held constant, the difference between the two groups was 
significant at the .05 level of confidence. But, when both SCAT 
scores and the criterion pre-test score were held constant, this 
significant difference disappeared. It was concluded that there 
was no real, significant difference between the picture group and 
the print group on the gain score. 

There was a total of 18 subjects, casualties, whose data 
were not used In the analysis. These were subjects who did not 
complete the four programs because of various reasons, or who com- 
pleted the four programs, but did not return for the criterion 
post-test. The question was raised that perhaps subjects who drop 



^Thls term used to identify lost data due to Illness, 
personal problems, etc., of subjects. 

^Cooperative English: Test, Higher Level 11-16, #645, 
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TABLE 2 



Analysis of Covariance on Gain Scores Holding 

SCAT Constant 



Source MS df E P 



Within 



36.44 61 5.23 <.05 



Between 



190.64 



1 



A CoQ^arison of the gain scores of the print and picture groups 
with respect to the scores of four Independent variables at three 
levels of achievement. 
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Reading Goiaprehenslon I High ' 33-44 !tll 11.45 :j 5 9.40 

Med. I 18-32 j 19 10.79 '21 15.00 

Low ! 11-17 I 3 11.00 ;i 4 18.00 



out from the program differ significantly on some Independent 
variable from the subjects who stay In the program. It can be 
seen that the means of the dropped subjects are fairly close to 
the means of the subjects In the print group. Therefore, It was 
concluded that these subjects were not really significantly 
different respecting any of the variables from the subjects who 
completed the program. There was no further analysis of the data 
from dropped subjects. 

Comparison of Gain Scores of the Print and Picture Groups 

A comparison of the gain scores of the print and picture 
groups with respect to the scores of four Independent variables 
at three levels of achievement provided a profile of the experimen- 
tal results. Each of the Independent variables was subdivided 
Into levels of high, medium, and low scores. Subjects In the 
picture group and In the print group were analyzed separately. 

Each subject was placed Into the high, medium, or low division on 
the basis of his criterion pre-test score; on the basis of his 
SCAT scores; on the basis of his English proficiency scores; on 
the basis of his reading vocabulary scores: and on the basis of his 
reading comprehension scores. In each of these divisions the 
average score of subjects at any given level was then determined. 

The range of each Independent score, the N of persons falling 
within that range, and the gain scores of the persons falling 
within that range are given In Table 3. 

It can be seen that those with high criterion pre-test 
scores In both picture and print groups gained less than those 
with medium and low criterion pre-test scores. This was to be 
expected, and can probably be explained by the operation of the 
celling effect which Is typical of many tests. After visual 
Inspection of Table 3, It was decided to compute jc— tests on the 
gain scores between corresponding levels for the experimental and 
control groups, and within levels In each group on two variables: 
the reading comprehension scores and the SCAT scores. 

Within Groups: Within the print group, a between-levels compari- 

son shows no significant difference In gains between high, medium, 
and low reading comprehension subjects. This can probably be 
explained by the simplicity of the text which was used In the print 
program. The text was usually not more than one to two sentences 
long, and difficult words were purposely omitted. 

However, there was a significant difference between the 
levels In the picture group. The?' between the high and medium 
subjects was a -2.68, significant at the .02 level of confidence. 
That Is, the gain score Is In favor of the medium group of subjects. 



The’V'between the high and the low subjects Is a -4.19, signifi- 
cant at the .001 level of confidence. Between the medium and low 
subjects, the*V*is barely significant. (t» -1.92; p - .10) 

Between Groups: In the medium SCAT range there was no significant 

difference between the picture and the print groups. The _t 
was equal to 1.60, non-slgnlf leant. In contrast, for the low 
SCAT range the"^”was significant at the .01 level of confidence, 
the^t’ibelng equal to a 3.15» gain in favor of the picture group. 
Thls'^indicated that the picture treatment was better for subjects 
who had low SCAT scores than the print treatment. However, it 
did not make a lot of difference which treatment subjects in the 
middle SCAT range received although there was a very slight 
advantage for the picture group which could scarcely be called 
significant. (Subjects in the high SCAT range were not compared 
because of the low N in the picture group.) 

On the reading comprehension breakdown, there was no signi- 
ficant difference between the high picture and the high print 
subjects. In the medium reading comprehension range the difference 
is only significant at the .10 level of confidence (t*1.89) 
between the picture and the print subjects. 

However, in the low reading comprehension range we find a signi- 
ficant difference between the picture and the print groups at the 
.05 level of confidence (t-2.99). In both the medium and the 
low levels the picture subjects did better. This seemed to indicate 
that the picture treatment was better for subjects in the medium 
and low reading comprehension ranges than was the print treatment. 

In summarizing the reading comprehension analysis, those 
having the lower reading comprehension scores in the picture treat- 
ment gained more from the program than those having high reading 
comprehension scores. There was no difference between the levels 
in the print group. A possible explanation is that the pictures 
handicapped those scoring high on reading comprehension. In 
other words, the better readers quickly scanned and comprehended 
the print material and gave either a brief glance at the picture 
or skipped it entirely (following their behavior in textbook and 
magazine reading). This would result in their not paying attention 
to that part of the program which was taught by means of the 
pictures. The slower readers or those which generally comprehend 
written material less ably, probably have learned to utilize 
pictures whenever available as a source of information and would 
tend to study the pictures on the slides as well as the print 
material. 



17 



o 



0 



Time to Complete Program 

I^en the picture and the print subjects were compared on 
program time (the time that they spent on all four units of the 
program), there were no significant differences. The print subjects 
spent an average of 101 minutes on the four units of the program: 
whereas, the picture subjects spent an average of 103 minutes on 
the program. 

There was also no significant difference between the 
picture and the print groups on the time they used In completing 
the simulation Items of the program. 



Time on Simulation Items and 
Performance Test Scores 

Two questions were considered In this analysis. One sought 
to know the difference between the picture and the print groups 
regarding the effect of the simulation Items on performance In the 
terminal functional behavior and the other asked, "Do subjects 
who spend a lot of time answering the questions on the simulation 
frames, also spend a lot of time performing a task on the perform*- 
ance rating scale?", and conversely, "Do subjects, who spend a 
short amount of time completing the simulation frame tasks In the 
program, go through the performance tests at a very fast rate of 
speed?" When the square analyses were made, there were no 
significant differences between subjects scoring on the rating 
scale (that Is, high or low) and the subjects speed on the simula- 
tion frames In the program (that Is fast or slow). In this analysis, 
picture and print subjects were analyzed separately. 



Learning Schedule on Program Units 

The subjects In the experiment were allowed to schedule 
their program sessions at will. Thus, a number of different 
sequence and time combinations resulted* that Is, some subjects 
took one session to complete all of the four program units, some 
took four sessions to complete all of the units, and some chose 
still other scheduling combinations. Also, there were those who 
completed all the programs In one day: whereas, others took more 
than two weeks to complete the program. 

"Does one pattern of scheduling enable subjects to learn 
more (as measured by gain scores) than another pattern?" A look 
at Table 4 shows the answer to this question was positive. The 
analysis Indicated that It seemed preferable for subjects to take 
the total library program In two sessions, and that the program 
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TABLE A 



Learning Schedule 

(Picture and Print Groups Combined) 



Time Elapse 
In Days 
(Unit 1 to 
Unit A) 


Sequence of 
Units Taken 


N 


Average 

Gain 


3 days 


2 units + 2 units 
or 

1 unit + 3 units 


15 


16.2 


3 days 


All Other Possible 
Sequences 


17 


13.2 


3 days 


2 + 2 or 1 + 3 


17 


.11.6 


3 days 


All Others 


26 


11.2 
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should be completed within three days. Further, it was best not 
to take the whole program at one sitting. This seemed to be the 
best for both the picture and the print subjects. Picture and 
print subjects were iirst analyzed separately, and then they 
(since no gross differences occurred) were combined into one group. 
Table 4 shows the combined group data dor this analysis. 

Analysis of Rating Scale Scores 

It will be recalled that the rating scale had three parts. 
The first analysis dealt with the total score for the entire 
test. 



A J^-test was run between the picture and the print subjects 
on this total. (t**1.81, df»72) This was significant only at the 
.10 level of confidence. When Part 3 of the rati.ng scale, the 
most difficult task, showed the greatest variance in scores, a 
Jt_—test was run between the picture and the print groups on Part 3 
only. This*V'was significant at .001 level of confidence 
(t«3.57, df«72). This difference was in favor of the picture 
group. 



, Analysis of Time as a Factor in Study of Picture Frames 

The programed Instruction for Unit 4 in the Picture group 
was broken down into the information frames which showed a picture 
and those which did not show a picture. The Unit 4 record charts 
for each picture slide were then analyzed as to the amount of time 
spent by each subject on each picture frome in the picture group. 

The amount of time spent by each subject in the print group on 
the equivalent slide was also obtained. The time per frame was 
compiled in seconds from the Esterline-Angus record charts. This 
indicated, that on the average, picture subjects spent 11.75 seconds 
perframe on the picture slides; whereas, on the equivalent slides, 
the print group spent an average of 10.60 seconds. This difference 
was significant at the .01 level of confidence. This analysis 
was not done for Units 1, 2, and 3 because of the great amount of 
staff time required to transform the appropriate time from the 
Esterline-Angus record charts into usable tabular data. 



Error Rate 



The record charts (Esterline-Angus) were also analyzed for 
program error rate. These Included the error rate on the review 
questions, the error rate on the by-pass questions, and the error 
rate on reinforcement (diagnostic) questions. The error rate on 
review questions refers to three questions at the beginning of each 
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unit pertaining to material learned In the previous lesson. The 
error rate on by-pass questions refers to how many subjects made or 
failed to gain the by-pass. The error rate on reinforcement 
(diagnostic) questions refers to all of the multiple choice questions 
within the program which were not by-pass qualifying questions. 

These diagnostic questions usually queried subjects about material 
taught In one to three slides previous to the question. There was 
no significant difference between the print and the picture groups 
In error rate on review questions or diagnostic questions. 



Relationship Between Mode of Instruction and By-Pass Success 

Unit 2 contained one by-pass which was a picture by-pass. 

It was a picture of a number of library books which were presented 
In a certain arrangement, and the subject had to tell by answering 
threct different questions whether or not these books were placed In 
proper order and» If not, what should be done with them. The 
print version of this by-pass was simply a diagram of several 
Dewey decimals, and the student was required to decide whether or 
not they were in order. In the picture group, an average of 1,22 
by-pass questions were correctly completed; whereas. In the print 
group an average of 0.49 by-pass questions were correctly completed. 
The difference between the two groups was significant at the .05 
level of confidence (t*«2,43, df=7). 

In Unit 3 of the program there were five possible by-passes 
none of which contained pictures. Here, there was an average of 
1,52 by-passes successfully completed by the picture subjects and 
1.93 by-passes successfully completed by the print subjects. This 
"Jt"was not significant. 
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IV. 



DISCUSSION 



The natursl characteristics of any inediuxD bein{^ researched 
dictate much of what can be extracted as useful information and 
data. 



Any attempt to study the picture must recognize at the 
outset that this medium is a stimulus form that develops many 
complex responses in the educational processes. Some of these 
responses are observable and many are not. Some of them involve 
overt behavior and others appear to be only covert mental responses. 
It is difficult to know anything about these latter responses. 

The results of the collection of data for this experiment 
are a number of kinds of information on the behavior of the sub- 
jects. These data were studied carefully for clues to a more 
definitive understanding of the effectiveness of the application 
of pictorial instruction to intrinsically programed material. 

The limits of time, funds, and personnel precluded the 
examination of some of the more complex data which were recorded 
by the instruments attached to the teaching machine. These may have 
been valuable if they had been examined. The reader must be re- 
minded that this particular study was not established as a large 
scale study in either design or funding, and consequently was 
basically limited to a pilot-sized study which, however, has by 
concentrated effort and the help of additional non-grant assistance 
been able to go beyond the limit of the single hypothesis for 
which the study was funded under its grant contract. 

The Gain Scores: 

Since programed materials have a special value for meeting 
variability in groups of learners, more than an analysis of gain 
scores for the whole group was considered desirable. The "whole 
group" analysis showed the picture treatment to be significantly 
better if the level of probability were accepted at a hi^er value. 
(<.05). Therefore, since variability in learners tends to occur 
within groups, an analysis within the two groups was made. 

As might be predicted, the most significant factor relating 
to the effectiveness of the picture was low ability in reading 
comprehension. It was here that the pictorial influence was most 
evident in its effectiveness toward a better learning experience. 
(Significant at the <.001 level). 
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The middle ranges In the picture group were much as middle 
ranges usually are-*>llttle affected by anything but extremes In 
treatment. 

A possible explanation for the value of the picture to the 
subject having a low level of reading comprehension may lie In the 
fact that he may have an ability deficiency In connection with 
reproducing some form of Iconographlc representation In order to 
understand and respond to the symbolic representation of which any 
written (paper and pencil response) test consists. Of course, this 
explanation Is really more of a hypothesis much In need of testing 
than a reason. 

The Performance (Rating Scale) Test: 

Probably the most useful result of using a performance rating 
Instrument lies In the ability of that test to uncover the most 
difficult part of a task area for which a subject Is receiving 
Instruction. Obviously, changes and Improvements In the teaching 
situation can be made. It was the difficult area that proved the 
worth of the pictures In the Instruction for the group which received 
them. 



The more difficult and unfamiliar material was most re- 
sponsive to the use of pictures. Thus, the pictures In the teaching 
machine program appeared to have provided picture Images retained In 
the minds of the picture group subjects which were to become cues to 
correct responses when an exact replica of common terminal functional 
behavior In the use of library materials was presented to them by 
the performance test. (Significant, <.001) 

This writer can conceive of no other way to evaluate 
accurately one of the most valuable principles of programed Instruc- 
tion In a learning situation; namely, determlng In advance the 
terminal functional behavior desired of the learner. 

As has been demonstrated In this study, written tests do 
not provide this, when other than verbal beha^or knowledge Is 
being taught. 

Time on Simulation Items and Performance Test Scores: 

The simulation Items were part of the basic content of 
both picture and print only programs. The slides in both 
cases, with one exception which Is discussed elsewhere, were 
Identical. (Both the Instructions for doing the task and the 
reinforcement questions and diagnostic content were all print) 
Therefore, the time for carrying out the exercise as recorded by 
the machine was the only measurable variable explicitly related 
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only to the simulation Items which could be economically analyzed. 

It was not surprising that It failed to Influence significantly 
since there were no real differentials In the learning stimuli 
other than such things as would relate to personality factors and the 

like. 

Program Time: 

It was thought that the plcure groups would go through the 
program faster. This was not the case. They took longer but the 
difference was not significant. Perhaps they found the pictures 
more Interesting than the print subjects found their characters to 
be. 



Theoretically, the picture subjects could have picked up 
what they needed to know faster from the pictures. The reason 
they did not may lie In the print oriented leamlng-set twelve or 
more years of schooling had developed In them. This provides 
still another opportunity for research. 

Error Rate: 

Examlng errors by simply counting them Is not a very revealing 
statistical procedure for any Intrinsic program when one wants to 
compare groups. The reason most probably lies In the fact that 
errors are part of the teaching procedure and most likely would not 
reflect any great differences between groups nor would they relate 
particularly to effectiveness of Instruction, Actually, they tend 
to tell more about the program than they do about the learner. 

The Amount of Time Subjects Studied Picture Frames: 

The analysis of the machine record of time subjects spent 
on looking at the pictorial material suggests there was a greater 
degree of Involvement In the Instruction when p^lctures were present 
than when there were no pictures. 

In the study, the picture subjects "stayed with It" longer. 
Noticing this. It was then not surprising to find that the picture 
group behavior proved to be better when the "going got tough". 
Evidently the greater time on the content of each pictorial 
Instructional slide resulted In more effective learning, as 
compared to the same content given In print form on slides. 

The ByPass Analysis: 

The most significant aspect of the analysis of the behavior 
on the by*^paooes was seen In the apparent ability of the picture to 
comnunlcate Ideas teaching arrangement and order as principles 
In finding library materials. The Insertatlon of a pictured book 
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arrangemeiit as an iten to detarmln^d eligibility for akipping aoine 
of the instrjction showed that che subjects not having pictorial 
material could go on only whatever pre-experiment training (with 
its Biental images) was brought to the situation by the learner* 
That this was inadequate was shown by the data* 



V. CONCLUSIONS AND IMPLICATIONS FROM THE MAJOR 

EXPERIMENT 



The preceding discussion oH the results of the major ex- 
periment represents the findings directly related to the hypothesis 
presented for this study. Although this report does not conclude 
with this main experiment but proceeds to investigate certain sub- 
sidiary questions y the conclusions presented at this point relate 
only to the findings of the foregoing experiment. 

The subsidiary experiments will be handled separately as an 
addition to the main report. This procedure has been chosen since 
the subsidiary studies do not fall under the specific experimenta- 
tion covered by the proposal submitted for the grant which supported 
this investigation. These subsidiary experiments represent only 
additional analyses and minor experiments related to programed 
materials which were thou^t to be of Interest to those who read 
the report. 

As was pointed out in the levels analysis section of the 
treatment of results previously described, it was observed that the 
subjects whose scores fell in the middle and lower ranges of their 
college ability tests showed significantly better understanding 
and matter of knowledge gained when the pictorial program was the 
mode of instruction. This same differential also appeared in 
connection with the reader of lower ability. 

It will be concluded then that the intrinsically programed 
instructional program on library usage having carefully designed 
pictorial content as part of the instructional mode produces a 
greater gain in learning for the student whose reading comprehension 
is either moderate or low than a similar program having no pictures. 

Thus, when one stops to consider the general use of programed 
materials he will see that they have a particularly valuable appli- 
cation in providing the slower learner with an opportunity to 
equalize himself with those who grasp things more quickly. The 
further step taken by this study suggests that within this set of 
values of programed materials there can be the additional value of 
incorporating the pictorial stimulus as an additional Improvement in 
instructional technique for the slower reader. 

It can be concluded that there is probably no reason to be 
concerned about the picture changing the amount of time required for 
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studying, since no significant differences vere observed In the 
amount of time on the program between the picture group and the 
group not having pictures. 

As was the case Immediately above In relationship to the 
program tlmey the study also would conclude that the bringing Into 
the Instructional program of simulation frames does not Increase the 
time required enough to be significant. 

Because the students were allowed to set up their own 
schedules for the study of the programed course In library Instruction 
there emerged several distinct patterns of a schedule for taking the 
four lesson units. As was Indicated In the results discussion , 
some students completed all of the four programed units In one 
long sitting, others took four separate sessions to finish and 
still others took the course units In coinblnatlons such as two at 
one sitting and two at another sitting or three at one sitting and 
one at a successive time and so forth. A general conclusion that 
ml^t be drawn from the analysis suggests that It Is preferable 
to study programed material, at least programed material presented 
by way of a teaching machine using Intrinsically programed material 
projected from slides. In moderate sessions probably not more than 
an hour at one time. Also, these sessions probably should not be 
overly extended. It Is questionable whether the matter of a given 
number of days would be applicable to all kinds of programed 
experiences. Of course, the length of programs would vary greatly. 
This Investigator would like to recomnend as a result of the 
observation of students at work, that "crash schedules" for re* 
medial or make up work with programed materials be avoided. This 
suggestion Is made recognizing that further research on the matter 
of ways of studying programed materials needs to be conducted. 

In the very Important area of the performance of a learner 
In the terminal functional situation It can be concluded that 
pictorial Instruction contributes significantly to Increased accuracy 
and efficiency In the use of a large university library. It Is not 
unlikely that similar results can be had In a wide range of other 
Instructional areas having objectives that are cognitively organized 
perceptual-motor functions. 

At first glance, the results of comparing the picture and non- 
picture subjects for differences In time spent studying the Instruc- 
tion slides seem to contradict the findings of the over-all program 
time comparison. However, remembering that the total programs con- 
tained simulative material and diagnostic material, it can be con- 
cluded that the greater time spent on the Individual pictorial 
Instruction slides was more than made up In faster progress with the 
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other progratan content, apparently due to a better graap of the 
content by the picture subjects i 

For the three kinds of program content which could produce 
stimuli provocative of error; (review items, diagnost^ items and 
by-pass qualifiers) the conclusion must be that the influence of 
the pictorial material is not likely to be observable where the 
only behavior called for lies in the area of symbolic representation 
(verbal, either written or spoken)* The implication is strongly 
toward the idea that values of pictorial instruction are more 
surely realized in overt behavioral responses than in spoken or 
written symbolic responses. 

One further conclusion drawn from the major experiment 
relates to success with by-passes* Problems presented in pictorial 
form will be handled better by those who have received their instruc- 
tion thru carefully designed pictorial experiences in the programed 
material they study* In other words, the mode of instruction will 
influence the mode of response. 

In aunmary, the several analyses conducted in this experiment 
indicate that pictorial instruction created specifically for 
intrinsic programed materials will produce a more effective self- 
instructional experience on the use of a library than a similar 
program that does not use a pictorial approach* 

The implication drawn is simply that, at least in similar 
kinds of subject matter, pictorial instruction will provide a more 
effective means of teaching* 



Recommendations 

Further research with respect to the employment of pictorial 
and other forms of iconographic representation needs to be conducted. 
For example, the aspect of the motivational power pictorial 
material can exert in an instructional program needs studying* 

Another problem lies in the identification of the elements 
which constitute a picture that will teach* Also, some mode of 
dissecting the complex mental reaction patterns set in motion by 
pictures could be outstandingly useful to the design of picture 
content that was to be used in instruction* 
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More future research with forms of pictorial instruction 
needs to be carried out recognizing that all which is learned from a 
photograph is not comprehended in terms of explicit written or 
printed symbolism, but is a translation from the iconic representa- 
tion of an idea thru a context of experience into the intellectual 
life of the learner. Each picture provides a complex message. 

Each message is constructed of a maze of sign stimuli which tend 
to elicit many different responses 
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SUBSIDIARY EXPERIMENTATION 



At the end of the major experiment. It was decided to extend 
the Investigation to Include upper division classmen* The subjects 
for these sub-studies were mostly college seniors In a 400 level 
Instructional materials course (N»62), One of the motivating factors 
for doing these subsidiary experiments was the desire to determine 
the generallsablllty of the earlier results. 

The hypothesis developed here stated that the null hypothesis 
of the major experiment would apply to the upper division students 
as It did to the freshmen used In the major experiment* 

Certain minor modifications to the programed material were 
made to better relate It to the senior subject* One example of this 
modification was to make the entrance to by-passes In unit three 
more difficult by requiring a sharper knowledge of the material 
being skipped. 

As In the main experiment, subjects were given the criterion 
pre-test and the criterion post-test and, also, the rating scale 
evaluation of actual performance In the library* 

The written criterion test was a refinement of the original 
test* The changes were largely to produce a more polished test and 
to upgrade certain Items to Include upperclassmen. This refined 
criterion test was the result of Improvements which evolved thru 
validation and use with a number of freshman English classes, the 
basic Instructional Materials classes, students specializing In 
library science, and the professional librarians on the staff of 
Morris Library. 

Final refinement of the performance evaluation Instrument 
occurred In these subsidiary experiments. These were largely 
administrative and mechanical In nature rather than conceptual or 
functional* 

Results 

Independent measures were obtained for both the picture and 
print groups. These were scores from the School -Co liege Ability Test 
reading comprehension (Cooperative English Test • Higher Level, 

#645, Buros), the grade point average, and letter grade In the 
course. There was no significant difference between scores of the 
two groups for either the SCAT or reading comprehension* However, 
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there was a significant difference between the two groups on the 
criterion pre-test score. This was significant at the .001 level 
of confidence. 

Due to the significant difference on the criterion pre-test 
scores • an analysis of covariance rather than variance was run on 
the gain scores. This analysis of covariance made an adjustment 
for the criterion pre-test score. There was a difference in favor 
of the picture group at the .05 level of confidence. 

The rating scale was administered to the picture group. The 
correlation between the rating scale and the criterion post-test 
was equal to .65 which was significant at the .001 level of confidence 
The correlation between the rating scale and the criterion pre-test 
score was .06. The criterion post-test correlation indicated that 
the rating scale correlated well with the criterion test; particularly 
since it is typical that rating scales do not correlate very 
highly with written measures* 

This is one indication that the criterion test was a 
valid general measure of ability to use the library. In addition, 
the fact that such a low correlation was attained between the 
rating score and the criterion pre-test score indicated that the 
rating scale as well as the criterion test measured what the 
subject learned during the program rather than the library knowledge 
with which the subject came into the program, prior to instruction. 
Kuder-Richardson reliabilities were *86 for the criterion pre-test 
and .77 for the post-test. 

In the rating scale, one of the tasks which subjects were 
required to perform was to fill out the call card as if they were 
checking a book out of the library. It was hypothesized that the 
subjects in the picture condition would write down the date of the 
book and the call number more often than would subjects in the print 
type condition. Chi-Square analyses were run using the dichotomies, 
date and no date on the one hand, and picture and print on the other 
hand. However, there was no significant difference whether total 
groups (picture and print) were used or whether the groups were 
broken down into male (picture and print) and female (picture and 
print) subjects. 

A second hypothesis was made that the males would differ 
from the females in the proportion of subjects who write down the 
date of the book. Again, results of male picture subjects 
versus female picture subjects, and male type subjects versus 
female type subjects indicated that there was no significant 
difference between the sexes on this variable. 



A third hypothesis vas that the subjects would circle their 
status rather than making a checks an X| or an underline more often 
In the picture group than In the print type group. This was because 
pictorial group subjects saw a correctly filled out call card In 
which their status was circled. The print group did not see the 
word "status" circled. They were just told that they should mark 
their status. The x2 analysis of total picture subjects versus 
total print subjects was equal to 3,00^> df * 1, The p was slgnlf- 
cant at the ,01 level of confidence. 

Final Comment: 

One of the findings of the study resulting from the use of 
several groups of college students suggests that such groups are 
useful for research In media variability because over a period of 
time the chance of any great fluctuations In characteristics of 
the subject groups becoming Influential on data appears to be 
sufficiently minor as to be disregarded* This Is suggested here 
slncvs the practice of using human subjects for research In learning 
has traditionally been f rocked with troubles In variability, 
attendance, and a number of other factors which make the admlnlstra* 
tlon of research dealing with human beings sometimes considerably 
difficult* The fact that this study was not troubled by any 
significant problems with respect to the type of subjects may be 
result of the simple fact of a certain amount of leveling which 
occurs In the policy on admissions of students for study in a 
university program. 



Discussion and Conclusions from the Subsidiary Experiments 

The analysis of covariance computed for the gain scores of the 
print«plcture group Involving the upper division subjects Indicated 
a moderately significant difference In favor of the picture 
group. The null hypothesis Is rejected on the basis of this analysis 
of the gain scores* In addition, the rejection of the hypothesis 
Is further substantiated by the results of the analysis of the per- 
forxDance rating scale with these subjects* Since this was slgnlf* 
leant at the point *001 level of confidence. It Is concluded that 
there Is an equally effective use of the picture for Instruction 
to teach library usage skills to upper division (seniors and 
juniors) college students when using programed material* 



A further hypothesis stated that the subjects lu the picture 
group In arranging to check out a book would write down on their 
call cards pertinent book Information more often than subjects In 
the print group* The analysis In this respect was not significant; 
therefore » the hypothesis was not supported. (In connection with 
this hypothesis » the matter of sex was examined* As was the case 
Imnedlately above » there was no significant difference between the 
sexes In this variable*) 

The conclusion to be drawn from this analyses suggests that a 
single picture which tries to describe a series of steps such as 
checking a book out Is not effective In programed materials* 

A third hypothesis stated that picture subjects would more 
often follow the example given In the picture than would the print 
group %rtio were Instructed by words to do the same thing as the 
picture showed* The analysis was significant In favor of the picture 
group* Therefore* It Is concluded that pictures used In programed 
material emphatically demonstrating a process can usually be counted 
on to provide better Instruction than printed instructions will 
provide* 

Reconmendatlons from the Subsidiary Experiments 

The program used for this research project demonstrated an 
ability to transcend the levels of student maturity and be effective 
at the extreme ends* This conclusion Is drawn partially from the 
data and also on the basis of comments from the subjects as a number 
of them were orally Interviewed at the conclusion of their learning 
experience* Further research with this concept Is needed In order 
to develop firmer guide lines for the preparation of pictorial 
programed materials which can deal with subject areas needed by 
students on various levels of academic attainment* 

It Is also suggested that more research is needed to 
determine with a greater degree of accuracy exactly the kinds of 
picture portrayal that produces the greatest amount of learning* 
This* of course* will need to be concerned with the kind of terminal 
beha^or desired* 
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SUMHARY 



The study was conducted to determine the value of colored 
photographs as parts of frames of programmed Instruction to orient 
freshmen to the use of the university library* The branching 
programs were presented to the subjects In the controlled labora- 
tory situation by randon access slide projectors* The subjects 
were volunteer freshmen assigned randomly to two groups* One 
group saw the program with Instruction frames combining colored 
photographs and print. The other group saw the program version In 
which the content of the pictures was translated Into print* A 
written criterion test was given both as a pretest and a post- 
test* The performance rating scale measured the ability to perform 
assignments on the floor of the library* There was no significant 
difference between the picture group and the print-only group In 
the gain scores on the written criterion test. Only students 
with low SCAT scores and low reading comprehension scores profited 
significantly more from the picture versions. Better readers 
probably skipped the pictures as unimportant. There was no diff- 
erence between the groups In time spent on the program. 

The program contained special frames designed to simulate 
the terminal behavior being taught. During the program students 
were required to find catalog cards , books, and references In 
the laboratory room. On the performance rating scale the picture 
group performed better at the .001 level of significance. There 
was no difference between the groups on error rate. The picture 
group was able to complete by-passes significantly better than the 
print-group. 

To conclude, most pictorial frames and simulation performance 
frames did not result In significantly greater gain scores on a 
written criterion test but did significantly Improve performance 
of actual skills In the library. 
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Appendix "A" 

Description of Physical Environment for the Experiment 



Physical Environment 



All students were given Individual Instruction. There was 
no group Instruction for any of the subjects. All of the Instruc- 
tion was given by the teaching machine. For this they were seated 
In a small learning room In which was placed a desk upon which was 
a remote control panel the student used to operate the random access 
projectors. Also, on the desk, one on each side of the remote 
control panel, was a library catalog card file drawer (tray) which 
represented the subject card catalog and the author title card 
catalog. In addition, there was a small table and bookshelves. On 
the table was a set of dictionaries* The bookshelves contained a 
typical section of a stack (shelves) of books, as well as two sets 
of encyclopedias. 

Three projectors were located in a room directly behind the 
student who was seated at this desk. The Instructional material on 
2x2 slides was projected by these machines through glass windows 
onto a screen which the student faced. This arrangement was de- 
signed In order to prevent noise from the equipment In the projection 
room disturbing the subject's ability to concentrate on the subject 
matter being given him. 

Any one of 150 programed Items could by called up for study 
pressing the proper keys on the remote control panel. All of the 
teaching used the Intrinsic or branching type of programming as 
the medium of Instruction, If a student became confused or was In 
need of special attention, he was able to ask for assistance by 
depressing a special call button which signaled an attendant 
nearby. However, this call button only occasionally was used by the 
students who were under Instruction, The equipment proved to be 
very reliable and not many students asked for assistance. 

The learning room as described was located on one of the 
lesser used floors of the library building. This location con- 
siderably reduced administrative detail. 

For other research and the subsidiary experiments an auto- 
matic Prlnt-out Device was Installed which typed the Information on 
tape. There was essentially no difference In the Information 
obtained by this device than the one used In the major experiment 
except the matter of convenience In reading the records. The Print- 
out tape was obviously more simple to analyse than Esterllne- 
Angus pen charts. 



Appendix ”B” 



rne Performance Rating Scale 



This appendix describes the Performance Rating Scale 

developed V^rinvestlgator for the 

terminal behavior required by the design of this study. 

This Instrument was used In concurrent wd subsequent 
experimentation conducted under another project carried o y 
Paul R. Wendt and this writer. (17) 

Several small pilot groups were used to irthe 

The results with these small trial groups are not Inc 
Sta given. These data functioned primarily as guldence In reach- 
ing tL form of the test that provided the data that Is given. 



Ferformatice Assignments and Rating Scale 



Students were given these assignments In the Southern Illinois University 
Library and were rated by project observers using the Performance Fating 
*^cale. 



Do the following library assignments: 

A. Show how you would find out if there are any books In the SIU Library 
on Veterinary Obstetrics, 

3. Actually find this book on the shelves and fill out a call card for 
lt**-T he Demon Lover , 

C. Using the Readers* Guide to Periodical Literature , find out which 
1949** magazine contains the article* ‘‘The Guy I*^o Gets Things Done ' 
by Carey MclTllllams, Then locate the article Itself* that Is, actually 
find the correct periodical and point out the article* 



** The year 1949 purposely chosen to make this task more difficult ^or the 
student* The articles published In 1949 are found In txjo different 
volumes of the Readers* Guide Instead of all being contained In one 
volume* 
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